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Abstract. We analyze tensors in C"‘<S>C’”0C™' satisfying Strassen’s equations for border rank 
m. Results include: two purely geometric characterizations of the Coppersmith-Winograd ten¬ 
sor, a reduction to the study of symmetric tensors under a mild genericity hypothesis, and 
numerous additional equations and examples. This study is closely connected to the study of 
the variety of m-dimensional abelian subspaces of End(C™') and the subvariety consisting of 
the Zariski closure of the variety of maximal tori, called the variety of reductions. 

Sommaire. Nous etudions des tenseurs dans C"‘iSiC™'(SiC’" satisfaisant les equations de Strassen 
lorsque le rang du bord vaut m. Les resultats obtenus comprennent : deux caracterisations pure- 
ment geometriques du tenseur de Coppersmith-Winograd, une reduction a I’etude des tenseurs 
symetriques sous une hypothese raisonnable de genericite, et beaucoup de nouveaux exemples 
et equations. Cette etude est liee de pres a I’etude de la variete des sous-espaces abeliens de 
dimension m de End(C"*) et la sous-variete obtenue comme I’adherence de Zariski de la variete 
des tores maximaux, appelee variete des reductions. 


1. Introduction 

The rank and border rank of a tensor T e (defined below) are basic measures 

of its complexity. Central problems are to develop techniques to determine them (see, e.g., 
[271 da da [23]). Complete resolutions of these problems are currently out of reach. For example, 
neither problem is solved already in This article focuses on a very special class of 

tensors, those satisfying Strassen’s commutativity equations (see M). The study of such tensors 
is related to the classical problem of studying spaces of commuting matrices, see, e.g. [mini 

sads]. 

To completely understand border rank, it would be sufficient to understand the case of border 
rank m in (see [271 Cor. 7.4.1.2]). We study this problem under two genericity 

hypotheses - concision, which essentially says we restrict to tensors that are not contained in 
some and lA-genericity, which is defined below. Even under these genericity 

hypotheses, the problem is still subtle. 

Let A,B,C be complex vector spaces of dimensions a, b,c, let T e A®B<S>C be a tensor. 
(In bases T is a three dimensional matrix of size a x b x c.) We may view T as a linear map 
T : A* B®C - Hom(C'*,R). (In bases, T((ai, •••,cia)) is the b x c matrix ai times the first 
slice of the a x b x c matrix, plus a 2 times the second slice ... plus times the a-th slice.) One 
may recover T up to isomorphism from the space of linear maps T(A*). 

One says T has rank one if T = a®b®c for some a e A, b € B and c € C, and the rank of 
T, denoted R(T) is the smallest r such that T may be expressed as the sum of r rank one 
tensors. Rank is not semi-continuous, so one defines the border rank of T, denoted R(r), to 
be the smallest r such that T is a limit of tensors of rank r, or equivalently (see e.g. [271 Cor. 
5.1.1.5]) the smallest r such that T lies in the Zariski closure of the set of tensors of rank r. 
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Write ar{Segi^A x FB x PC')) c A®B®C for the variety of tensors of border rank at most r 
(the cone over the r-th secant variety of the Segre variety). We will be mostly concerned with 
the case a = b = c = m. 

To make the connection with spaces of commuting matrices, we need to have linear maps from 
a vector space to itself. Define T e A®B®C to be lA-generic if there exists a ^ A* with T{a) 
invertible. Then T{A*)T{a)~^ c End(i?) will be our space of endomorphisms and Strassen’s 
equations for border rank m is that this space is abelian, i.e., in bases we obtain a space of 
commuting matrices. 

Of particular interest is when an m-dimensional space of commuting matrices, viewed as 
a point of the Grassmannian ^(m, End(i?)), is in the closure of the space of diagonalizable 
subspaces (i.e., the maximal tori in gG), which is denoted Red{m) in [21]. Much of this paper 
will utilize the interplay between the tensor and endomorphism perspectives. 

Our primary motivation for this paper comes from the study of the complexity of the matrix 

2 2 2 

multiplication tensor e C" 0C”' 0C” . We initiate a geometric study of the tensors used 
to prove upper bounds on the exponent of matrix multiplication, especially the Coppersmith- 
Winograd tensor. In [2] they showed that one cannot prove the exponent of matrix multiplication 
is less than exponent 2.3 using the laser method applied to the Coppersmith-Winograd tensor 
that was used for the current world record in [HI |39l |32| . The authors suggested that to improve 
the upper bound on the exponent one should look for other tensors that give even better upper 
bounds via the laser method. While the tensors of Strassen and Coppersmith-Winograd were 
defined in terms of their combinatorial properties, we thought it would be useful to isolate their 
geometric properties, and use these geometric properties as a basis for the search. One geometric 
property is that they have (near) minimal border rank and relatively large rank. In this paper 
we find other tensors with the same property and we hope to investigate their value (in the 
sense of [MiiMiEaig) in future work. On the other hand, to our surprise, we isolate two 
further geometric properties that essentially characterize the Coppersmith- Winograd tensors, see 
Theorems El and El which hints that one might have already reached the limits of the laser 
method. 

Another motivation from computer science is the construction of explicit tensors of high rank 
and border rank, see, e.g., BET]. We give several such examples. 

Our results include 

• Two purely geometric characterizations of the Coppersmith-Winograd tensor (Theorems 
17.41 and 17.5p . 

• Determination of the ranks of numerous tensors of minimal border rank including: all 
lyi-generic tensors that satisfy Strassen’s equations for m = 4 and m = 5. 

• Proof, in HI when m < 4, of a conjecture of J. Rhodes [U Conjecture 0] for tensors in 

that their ranks cannot be twice their border ranks, and counter-examples 
for all m > 4 (Proposition 16.6^ . 

• Explicit examples of tensors with rank to border rank ratio greater than two (Proposition 
16.111 and Theorem I6.12p . 

• Proof that the flag algebras of [24] are of minimal border rank, D 

• Explicit examples showing that the known necessary conditions for minimal border rank 
are independent. 

• 1-generic tensors satisfying Strassen’s equations, but far from minimal border rank, HI 

• Proof that 1-generic tensors satisfying Strassen’s equations must be symmetric (Propo¬ 
sition El]). 

• New necessary conditions for border rank to be minimal (Theorem l2.4p with an example 
fExample 15.6p . answering a question of A. Leitner [33] . 
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• A class of tensors for which Strassen’s additivity conjecture holds iTheorem ld.ip . 

1.1. Background and previons work. The maximum rank of T e is not known, 

it is easily seen to be at most m? (and known to be at most [7|), and of course is at least 

the maximum border rank. The maximum border rank is except when m = 3 when it 

is five |34l I40j . In computer science, there is interest in producing explicit tensors of high rank 
and border rank. The maximal rank of a known explicit tensor is 3m - log 2 (nT,) - 3 when m is a 
power of two [T], see Example 13.31 

Tensors in A®B®C are completely understood when all vector spaces have dimension at most 
three m- In particular, for tensors of border rank three, the maximum rank is five. The case 
of is also completely understood, see, e.g. m § 10.3]. While tensors of border rank 

4 in are essentially understood da [201 [5], the ranks of such tensors are not known. 

We determine their ranks under our two genericity hypotheses. The difficulty of understanding 
border rank four tensors in C^0C^0C^ (which was first overcome in da) non-concision, 
which we avoid in this paper. 

Let RedP’^^ (m) denote the set of all maximal tori in SL{m), i.e., the set of all (m - 1)- 
dimensional abelian subgroups that are diagonalizable. It can be given a topology (called the 
Chabauty topology, see [33]) and its closure Red^^{m) is studied in [33] • (A. Leitner works 
over M, but this changes little.) If one considers the corresponding Lie algebras, one obtains a 
subvariety of the Grassmannian Red^\m) = Red{m) c G{m-l,5lm) that was studied classically, 
and is called the variety of reductions in |24j . More precisely, 

Red{m) = {E e G{m - l,5[m) \ a basis of E is simultaneously diagonalizable}. 

One can equivalently prove results at the Lie group or Lie algebra level. As the Cartan subalge¬ 
bras of slm and glm can be identified, by adding and dividing out by identity, we may equivalently 
work in the Grassmannian G(m,g(m)- 

We present the results of |33j (some of which we had found independently) in tensor language 
for the benefit of the tensor community. 

A tensor T e A®B®G is A-concise if the map T ■ A* ^ B®G is injective, and it is concise if 
it is A, B and G concise. Equivalently, T is A-concise if it does not lie in any A'®B®G with 
A' ^ A. Note that if T is A-concise, then R(r) > a. 

Definition 1.1. If b = c-m define T e A®B®C to be lA-generic if T(A*) contains an element 
of rank m. Define 1b, Ic genericity similarly and say T is 1-generic if it is l^i, 1b and Ic-generic. 

Note that if T is lyi-generic, then T is B and G concise and in particular, R(r) > m. 

1.2. Organization. In ^we describe necessary conditions for l^-generic tensors to have border 
rank m. In addition to Strassen’s equations, there is an End-closed condition, flag genericity 
conditions, and infinitesimal flag genericity conditions, the last of which is new. In ^ we 
describe the method of [I] for proving lower bounds on the ranks of explicit tensors. This 
method has a consequence for the study of Strassen’s additivity conjecture that we describe 
in 0 In ^we study lyi-generic tensors satisfying Strassen’s equations that have border rank 
greater than m, giving explicit examples where each of the necessary conditions fail and showing 
that such tensors can have very large border rank. Moreover, we show that a 1-generic tensor 
satisfying Strassen’s equations is isomorphic to a symmetric tensor. In ^we study ly^-generic 
tensors of minimal border rank, presenting a sufficient condition to have minimal border rank, 
classifications when m = 4,5, computing the ranks as well, and explicit examples of tensors 
with large gaps between rank and border rank. We conclude in ^ with a geometric analysis 
of tensors that have been nseful for proving upper bounds on the complexity of the matrix 
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multiplication tensor, in particular, giving two geometric characterizations of the Coppersmith- 
Winograd tensor. 


1.3. Notation. Let y be a complex vector space, V* = {a : V ->■ C | a is linear} denotes the 
dual vector space, denotes the k-th. tensor power, S^V denotes the symmetric tensors in 
equivalently, the homogeneous polynomials of degree k on V* , and A^V denotes the skew- 
symmetric tensors in 1/®^. If [7 c 1/ (resp. v e V), we let c V* (resp. c V*) denote its 
annhilator. 

Projective space is PP = (P\0)/C*. For u e P, [u] e PP denotes the corresponding point in 
projective space and for any subset Z c PP, Z cV is the corresponding cone in P. For a variety 
X c PP, Xsmooth denotes its smooth points. For x e Xsmooth, c V denotes its affine tangent 

space. For a subset Z aV or Z c PP, its Zariski closure is denoted Z. 

The irreducible polynomial representations of GL{V) are indexed by partitions tt = 
with at most dimP parts. Let £{Tr) denote the number of parts of vr (so £{{pi,---,Pq)) = q), and 
let SttP denote the irreducible GL(P)-module corresponding to vr. The conjugate partition to 
TT is denoted tt'. 

Since we lack systematic methods to prove bounds on the ranks of tensors, we often rely on 
the presentation of a tensor in a given basis to help us. For example, the structure tensor for 
the group algebra of in the standard basis looks like 




' Xo Xi Xm-l^ 

^ m -1 ^0 ^1 

^ Xi X2 ••• Xo ^ 


Xj e C} 


but after a change of basis (the discrete Fourier transform), it becomes diagonalized so in the 
new basis it is transparently of rank and border rank m. 

For T e A®B®C , introduce the notation for T{A*) omitting the xj e C, e.g., for Mc[z^](A*), 
we write 


( 1 ) 


' Xo 

^m-1 

X\ ■■■ Xm—l'^ 
Xq Xi 



K Xl 

X2 Xo y 


For tensors T,T' e = A®B®C, we will say T and T' are strictly isomorphic 

if there exists g e GL(A) x GL(B) x GL{C) such that g{T) = T' , and we will say T,T' are 
isomorphic if there exists g e GL{A) x GL{B) x GL{C) and a e ©3 such that a{g{T)) = T'. 


1.4. Acknowledgments. We thank the Simons Institute for the Theory of Computing, UC 
Berkeley, for providing a wonderful environment during the fall 2014 program Algorithms and 
Complexity in Algebraic Geometry during which work on this article began. We also thank 
L. Manivel for useful discussions and pointing out the reference [33], and the anonymous referee 
who gave many useful suggestions. Michalek is a member of AGATES group and a PRIME 
DAAD fellow. 


2. Border rank m equations for tensors in 

2.1. Strassen’s commutativity equations. Throughout this sub-section dimB = dimC* = m. 
Given T e A®B®G and a e A*, consider T{a.) e B®G = Hom(C'*,B). If T{a) is invertible, 
for all a' e A*, we may consider T{a')T{a)~^ ■ B ^ B. Let [A,P] = XY - YX denote the 
commutator of the matrices X,Y. 
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Strassen’s equations [ID] are: for all a,ai,a 2 e A* with T(a) invertible,, 

rank[T(ai)T(a)-\T(a 2 )T(a)-^] < 2(R(T)-m). 

In particular, if R(r) = m, then the space T{A*)T{a)~^ c End(i?) is abelian. It is also useful 
to use Ottaviani’s formulation of Strassen’s equations [35|: consider the map 

: B*®A ^ A^A®C 
fi®a a /\T{j3). 

If dim^d = 3, R{T) > ^rank(T^). If one restricts T to a 3-dimensional subspace of A*, the same 
conclusion holds. In general rank(r^) < (a - I)R(r), because for a rank one tensor a®b®c, 
(a®b<Sic)')^{A<SiB*) = a A A®c, i.e. rank(a( 8 ) 6 ®c)^ = a - 1 . 

To deal with the case where T{a) is not invertible in Strassen’s formulation, recall that a 
linear map f : B ->■ C* induces linear maps : A^B A^C*, and that A^~^B B*^A^B. 

Thus - 9 - A'^~^C* may be identified with (up to a fixed choice of scale) a linear 

map B* ^ C, and thus its transpose may be identified with a linear map C* B. If / is 
invertible, this linear map coincides up to scale with the inverse. In bases it is given by the 
cofactor matrix of /. So to obtain polynomials, use A'^~^B* in place 

of T{a)~^ by identifying - C*^ A'^~^B* ^ B, see [271 §3.8.4] for details. 

As a module, as observed in [29], Strassen’s degree m + 1 A-equations are 

(2) Sm-l,l,lA*®S2^lm-lB*®S2,lm-lC*. 

2.2. The flag condition. Much of this paper will use the fact that T e A®B®C may be 
recovered up to strict isomorphism from the linear space T{A*) c B®C, and if dimR = dimC 
and there exists a ^ A* with T{a) invertible, T may be recovered up to isomorphism from the 
space T{A*)T{a)~^ c End(R). In this regard, we recall: 

Proposition 2.1. [271 Cor. 2.2] There exist r rank one elements of B®C such that T{A*) is 
contained in their span if and only if R(T) < r. Similarly, R(T) < r if and only if there exists a 
curve Et in the Grassmannian G{r, B®C), where for t 0, Et is spanned by r rank one elements 
and T{A*) c Eq (which is defined by the compactness of the Grassmannian). 

The following two results appeared in [IH Ex. 15.14] and [33l Cor. 18]: 

Corollary 2.2. Let a = m and let T e A®B®C be A-concise. Then R(T) = m implies that 
T(A*)nSeg(FBxFC)*0. 

Proof. If Et e G{r,B®C) is spanned by rank one elements for all t + 0, then when t = 0, it must 
contain at least one rank one element. But since a-m, T{A*) = Eq. □ 

Corollary 2.3. Let T e A®B®C with a = m be A-concise. IfR(T) = m, then there exists a 
complete hag Ai c ■■■Am-i c Am - A*, with dim Aj = j, such that FT{Aj) c aj{Seg{FB x PC')). 

Proof. Write T{A*) = limi^ospa'R{Aii(t),•••, Aim(t)} where Xj{t) e B®C have rank one. Then 
take PAfc = Plimi_>o span{Xi(t), •••,Xfc(t)} c Pr(A’''). Since P{Xi(t), Xk{f)} c ak{Seg{FB x 
PC')) the same must be true in the limit, and each limit must have the correct dimension because 
dimlimt^o span{Xi(t), A'm(t)} =m. □ 

Call the implication of Corollary 12.31 the flag condition. 

There are infinitesimal and scheme-theoretic analogs of Corollary 12.31 but we were unable to 
state them in general in a useful manner. Here is a special case that indicates the general case. 
For another example, see El For a variety X c PE, and a smooth point x e X, T^X c V 
denotes its affine tangent space. 
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Proposition 2.4. Let T e A®B®C with sl = m be A-concise. IfR(T) = m and T{A*)nSeg{FBx 
PC') = [Xq] is a single point, then P(r(A*) n x PC')) must contain a line. 

Call the implication of Proposition 12.41 the infinitesimal flag condition. 

Proof. Say T{A*) were the limit of span{Xi(t), •••,Xm(t)} with each Xj{t) of rank one. Then 
since Pr(^*) n Seg{¥B x PC) = [^o]) we must have each Xj{t) limiting to Xq. But then 
limf_>o span{Xi(t), X 2 (t)}, which must be two-dimensional, must be contained in T[XQ]Seg{¥B x 
PC) and r(^’^). □ 

Remark 2.5. Because these conditions deal with intersections, they are difficult to write down as 
polynomials. We will use them for tensors with simple expressions where they can be checked. 

2.3. Review and clarification of results in [29]. Throughout this subsection we assume 
b = c = m. To a ly^-generic tensor T e A®B®C, fixing oq ^ as in Definition 11.11 associate a 
subspace of endomorphisms of B: 

Sao{T) ■■= {T{a)T{ao)-^ | a e c End(B). 

Note that T may be recovered up to isomorphism from 
Lemma 2.6. Let T e A®B®C he lA-generic and assume rank(T(ao)) = 

(1) If R(T) = m then EafiT) is commutative. 

(2) IfEafiT) is commutative then Ea'^{T) is commutative for anya'g e A* such that rank(T(aQ)) = 

m. 


Proof. The Hrst assertion is just a restatement of Strassen’s equations. For the second, say 
EafiT) is commutative, so 

(3) T{ai)T{ao)-^T{a2)=T{a2)T{ao)-^T{ai) 
for all 01 , 0:2 ^ A*. We need to show that 

( 4 ) T(oi)r(o[,)-^r(o2) =T(o2)T(o[,)-^T(oi) 

foralloi ,02 ^ A*. Since £’cg(T) is commutative, we have T(oq)T(oo)~^T'(o 2 ) = T(o 2 )T'(oo)~^T'(oq) 
and T(oq)T(oo)~^T(oi) = T(oi)T(oo)~^T(oq), i.e., assuming T(oi),r(o 2 ) are invertible, 

r(oo)-^ = T{a'g)-^T{aj)T{ao)-^T{a'g)T{aj)-^ for j = 1 , 2 . 

Substituting the j = 2 case to the left hand side of ([3|) and the j = 1 case to the right hand side 
yields dH). The cases where T{aj) are not invertible follow by taking limits, as the o with T{a) 
invertible form a Zariski open subset of T{A*). □ 

If 1/ c B*®B is commutative, then we may consider it as an abelian Lie-subalgebra of 0 [(il). 
Define 

Abel A ■ = PjT e A®B®C | T is A - concise, 

3oo e A* with rank(T(oo)) = m, and Ea^fiT) c g[(II) is an abelian Lie algebra} 

= P{T e A®B®C I r is ^ - concise, 1a - generic and 
Vo e A* with rank(r(o)) = m,Ea{T) c qI{B) is an abelian Lie algebra} 

The second equality follows from Lemma l2.6f 21. 

Definition 2.7. We say T e A®B®C is an A-abelian tensor if T e AbelA- 
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AbelA is a Zariski closed subset of the set of concise 1^-generic tensors, namely the zero set 
of Strassen’s equations. Its closure in A®B®C is a component of the zero set of Strassen’s 
equations. 

Define 

DiaQA '■ = lP{r € A®B®C | T is ^ - concise, 

Bag ^ with rank(T(ao)) = m, and 6ao{T) c 0 [(i?) is diagonalizable}, 

= P{T e A®B®C I T is A - concise, 1a - generic and 

Va e A* with rank(T(a)) = m, £a{T) c Qi{B) is diagonalizable}. 

Let DiagA be the Zariski closure of Diag\ and let Diag^ be the intersection of DiagA with 
the set of concise 1 ^-generic tensors. 

Proposition 2.8. [29] Let A,B,C = C™, let T € A®B®C he concise and lA-generic. Then the 
following are equivalent: 

(1) R(T) = m, 

(2) T € Diag\. 

Moreover, an abelian m-dimensional subspace of 0 [(R) is in the closure of the diagonalizable 
subspaces if and only if it arises as Sa(T) for some concise, border rank m tensor T e A®B®C. 

Proof. Since the proof in the literature is not explicit and we use it frequently, we show that if 
T e A®B®C is concise, then Sa{T) belongs to the limit of diagonalizable subalgebras. We know 
there exists a curve of m-tuples of rank one tensors such that in the Grassmannian 

limspan{I}^(Zl^)}-.r(Zl’^). 

In particular, there exist Xt e span{r/(^*)}, such that Xt T{a) and we may assume that 
Xt are invertible. Then, span{T^{A*)}Xf^ is a curve of diagonalizable algebras converging to 
£a{T). □ 


2.4. The End-closed condition. Throughout this subsection we assume b = c = m. Define 

End - Abel A ■= P{Z e AbelA | 3a e with rank(r(a)) = m, and £a{T) is closed under composition}. 

Remark 2.9. There was ambiguity in the definition of Comma,h in pS] that is clarified by the 
above notions which replace it. 

The following Proposition essentially dates back to Gerstenhaber [2T] . It is utilized in [331 §5] 
to obtain explicit abelian subspaces that are not in Red{m), see ^5.11 

Proposition 2.10. lfT& A®B®C, with h = c = m is lA-generic, R(r) = m and rank(T(ao)) = 
m, then SadT) is closed under composition. 

Proof. Each diagonalizable Lie algebra is closed under composition. The property of being closed 
under composition is a Zariski closed property. □ 

Proposition 2.11. Let T e End - AbelA SLnd rank(r(ao)) = m. Then SaoiT) = £a'^{T) for any 
Oq e A* such that rank(r(aQ)) = m. In particular. 

End-AbelA = PIT e AbelA \ Va e A* with rank(T(a)) = m,£a{T) is closed under composition}. 

Proof. By the End-closed condition applied to a'g, for any a € A* there exists a' e A* such that 

r(a)r(a')-ir(ao)r(a[,)-i = T{a')Tia'o)-^ 
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i.e., 

T(a)r(a')-i = T{a')T{a'o)-^T{a'o)T{aor^ 

= T{a')T{ao)-^ 

so £a'g{T) c £a^{T). As both spaces are of the same dimension, eqnality mnst hold. □ 

Note the inclnsions 

Diagj^ £ End - Abel a £ Abel a- 

These spaces all coincide when m < 4, Diag^j^ = End - Abel a for m = 5, End - Abel a 5 Abel a 
when m > 5 (see M), and are all different when m > 7 (see ^5.2p . 

Proposition 2 . 12 . The subvariety End - AbelA in the set of 1 a- generic tensors has equations 
that as a GL{A) x GL{B) x GL(G)-module include 

A l8)( ^ ). 

|7r|=m+l 

,£(7r)<m 

These equations are of degree 2m + 1. 

Proof. For a basis of A*, if T e End - AbelA, then for all a, a' e A*, 

r(a)(r(ai)^”^-i)^T(a')cspan{T(ai),-,r(a^)}. 

In other words, the following vector in IG^^^{B®G) mnst be zero: 

T{a){T{aiY'^-^)'^T{a') a T{ai) a ■■■ a T{a^). 

The entries of this vector are polynomials of degree 2m +1 in the coefficients of T, as the entries 
of (r(ai)^”*“^)^ are of degree m - 1 in the coefficients of T and all the other matrices have 
entries that are linear in the coefficients of T. Among the qnantities that mnst be zero are 
the coefficients of 6 i 0 ci a ••• a bi®Cm a 62 ®ci, and more generally the coefficients of 5i0ci a ••• a 
hi®Cq^^ A • • • A 0ci A • • • A where vr = (pi, • • ■,) is a partition of m -i-1 with first part at 

most m, qi < m, and n' = ((?i,•”)9pi)• Now take a,a' = a 2 , the corresponding coefficients have 
the stated weight and all are highest weight vectors. □ 

3. The Alexeev-Forbes-Tsimerman method for bounding tensor rank 

Because the set of tensors of rank at most r is not closed, there are few techniques for proving 
lower bounds on rank that are not just lower bounds for border rank. What follows is the only 
general technique we are aware of. (However for very special tensors like matrix multiplication, 
additional methods are available, see [28].) The method below, generally called the substitution 
method was introduced in [36| and used in [iTiiig among other places. We follow the novel 
application of it from [T]. Fix a basis oi, •••, of A. Write T = a* 0 Mi, where Mi € B ® G. 

Proposition 3.1. [U Appendix B], [U Chapter 6] Let R(T) = r and Mi t 0. Then there exist 
constants A 2 ,..., Aa, such that the tensor 

a 

f :=Y, ® {Mj - XjMi) e a/0B0C', 

1=2 

has rank at most r - 1. Moreover, if rank(Mi) = 1 then for any choice of (A 2 , •••, Aa) we have 
R(f) >r-l. 

The statement of Proposition 13.II is slightly different from the original statement in [T], so we 
give a modified proof: 
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Proof. By Proposition 12.11 there exist rank one elements Xi,... ,Xr e B®C and scalars such 
that: 

M,- = ^ <p;xu. 

U=1 

d}- ~ 

Since Mi 0 we may assume dj 0 and define \j = Then the subspace r(ai-‘') is spanned 

by X 2 ,... ,Xr so Proposition 12.11 implies R-(r) < r - 1. The last assertion holds because if 
rank(Mi) = 1 then we may assume Xi = Mi. □ 

Proposition I, I. II is usually implemented by consecutively applying the following steps, which 
we will refer to as the substitution method: 

(1) Distinguish A, take a basis {aj} of it and take bases{/?s}, { 71 } of B*,C* and represent 
T as a matrix M with entries that are linear combinations of the basis vectors a^: 

= r(/3s ® 7t). 

(2) Choose a subset of b' columns of M and c' rows of M. 

(3) Inductively, for elements of the chosen columns (resp. rows) remove the nonzero u-th 
column (resp. row) and add to all other columns (resp. rows) the u-th column (resp. row) 
times an arbitrary coefficient A, regarding the aj as formal variables. This step is just 
to ensure that each time only nonzero columns or rows are removed. 

(4) Set all Oj that appeared in any of the selected rows or columns to zero, obtaining a 
matrix M^ Notice, that M’ does not depend on the choice of A. 

(5) The rank of T is at least b' plus c' plus the rank of the tensor corresponding to M'. 

The above steps can be iterated, interchanging the roles of A, B and C. 

Example 3.2. [T] Let 


T{A*) 


'xi 

Xl 

Xl 

Xl 


X2 

X2 


Xl 

Xl 

xz 


X2 


Xl 

\Xi 

X3 


X2 

Xl) 


where here, and in what follows, blank entries are zero. Then R(r) > 15. Indeed, in the first 
iteration of the method presented above, choose the first four rows and last four columns. One 
obtains a 4 x 4 matrix M' and the associated tensor T', so R(T') > 8 + R(r'). Iterating the 
method twice yields R(T) >8 + 4 + 2 + 1 = 15. 

On the other hand R(T) = 8, e.g., because T{A*), after a choice of a^, is a specialization of 
a space that is abelian and contains a regular nilpotent element and we conclude by Corollary 
16.21 below. 

To see that R(T) = 15, one can construct an explicit expression or appeal to Proposition 16.31 
because T{A*) is a degeneration of the centralizer of a regular nilpotent element. 

This generalizes to T e of rank 2 * 2^ - 1 and border rank 2^. 
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Example 3.3. [T] Let T = ai 0 {bi®ci+---+bs 0 cs)+a 2 ®{bi 0 CQ+b 2 ®CQ+b^®cj+b 4 ®cs)+a 3 ®{bi^cj+ 
b 2 ®c%) + ai®bi®c% + a^®b%®ci + aQ®b%®C 2 + a 7 ®bs®cs + a 8 ® 68 ®C 4 , so 


T{A*) 


^Xi X5^ 

Xi Xq 

Xl Xj 

Xi X8 

X2 Xl 

X2 Xl 

X3 X2 Xl 

^X4^ X3 X2 Xl) 


Then R(T) > 18. Here we start by contracting xs,xg; 2 : 7 ,a; 8 . We obtain a tensor T represented 
by the matrix 

<xi > 

Xl 

Xl 

Xl 


X2 

Xl 


X2 

Xl 

X3 

X2 

Xl 

\X4 

CO 

to 



and R(T') > 4 + R(T). The substitution method then gives R(T') > 14. In fact, R(T) = 18; it is 
enough to consider 17 matrices with just one nonzero entry corresponding to all nonzero entries 
of T(A*), apart from the top left and bottom right corner and one matrix with 1 at each corner 
and all other entries equal to 0. This generalizes to T e of rank 3 * 2^ - k - 3. 


For tensors in the limit of the method would be to prove a tensor has rank at 

least 3(m-1), and this can be achieved only by exchanging the roles of A, B, C in the application 
successively. 


4. A Remark on Strassen’s additivity conjecture 

Strassen’s additivity conjecture [l3] states that the rank of the sum of two tensors in disjoint 
spaces equals the sum of the ranks. While this conjecture has been studied from several different 
perspectives, e.g. [m ESI 0 nig], very little is known about it, and experts are divided as to 
whether it should be true or false. 

In many cases of low rank the substitution method provides the correct rank. In light of this, 
the following theorem indicates why providing a counter-example to Strassen’s conjecture may 
be difficult. 

Theorem 4.1. Let Ti e Ai®Bi®Ci and T 2 e A 2 ®B 2 ®C 2 he such that that R(ri) can be 
determined by the substitution method. Then Strassen’s additivity conjecture holds for Ti ©T 2 , 
i.e, R(ri © Ta) = R(ri) + R(r 2 ). 

Proof. With each application of the substitution method, Ti is modified to a tensor of lower 
rank living in a smaller space and T 2 is unchanged. After all applications, Ti has been modified 
to zero and T 2 is still unchanged. □ 

The rank of any tensor in T?®B®C can be computed using the substitution method as follows: 
by dimension count, we can always find either (3 e B* or 7 e C* , such that r(/3) or T^y) is a 
rank one matrix. In particular. Theorem 14.11 provides an easy proof of Strassen’s additivity 
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conjecture if the dimension of any of Ai,Bi or Ci equals 2. This was first shown in |25] by other 
methods and is further investigated by Buczyhski and Postinghel, see m- 


5. Abelian tensors in with border rank greater than m 


5.1. End - AbelA ^ AbelA for m > 5. The lower bounds for border rank in the following two 
propositions appeared in [33l Def. 16] in the language of groups. It answers [Ml Question A] 
and provides an example asked for in m Remark after Question B] and a concise 1-generic 
tensor T e C^ 0 C^ 0 C^ with R(r) = 6 satisfying Strassen’s equations. 

Proposition 5.1. LetTieit ,5 = Oi 0 ( 6 i 0 ci + 62 ®C 2 + f) 30 C 3 + 640 C 4 + 650 C 5 )+ 020 ( 61003 + 63005 )+ 
03061004 + 04062004 + O 50620 O 5 , which gives rise to the linear space 


fxi 




0 

Xl 



X 2 

0 

Xl 


X3 

X 4 

0 

Xl 

\0 

X 5 

X 2 

0 Xiy 

but 

not 

End 

-closed. I 


TLeitd^l = 


Then £^i{TLeit, 5 ) is an abelian Lie algebra, but not End-closed, l.e., ^ AbelA but TLeit.s 

End - AbelA- In particular, TLeit,b i DiagA so > 5. In fact, R(rLeit, 5 ) = 6 and 

R(dLeiL5) = 9- 


Proof. The first statements are verifiable by inspection. The fact that the border rank of the 
tensor is at least 6 follows from Theorem 12.81 The fact that border rank equals 6 follows by 
considering rank one matrices: 


Ai = 


\ 


/ \ 


/02 0^ 


,X2 = 

0 o2 

,^3 = 


1 1 





\1 1 J 


a e j 









A 4 


e e 
1 e 


,X5 


1 -e 


,^6 


\ 1 


Then 


TLeit,5 = 11™ - 5 -Ol 0 (-Xi + X 3 + A 4 + A 5 + Xq) + -a2®{X2 - X^) + O 30 A 5 + O 40 A 4 + 050 X 5 , 


which is a sum of six rank one tensors. In terms of tensor products, 

TLeit ,5 = lim^[ -Oi0(6i + 62)0(04 + 05) + eo20(6i +063)0(05 +003) 

£-*■0 e 

+ (oi - 002)0(61 + e‘^b5)iS>{c5 + o^ci) + (oi + 0^04)0(62 + 063)0(04 + 0C3) 
+ (oi + 0^03)0(61 - 063 + 0^64)004 + (oi + 0^05)0620(05 - 0C3 + 0^02)]. 


The substitution method shows that Il{TLeit, 5 ) ^ 9. To prove equality, consider the 9 rank 1 
matrices: 

(1) 3 matrices with just one nonzero entry corresponding to X 3 ,X 4 ^,X 5 , 
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(2) The six matrices 


/I \ / \ / 


\-l / \ -1 1/ \ 


1 


1 


/ \ 


\ / \ / \ 


11 , 1-1 


/ \1 1 / \-l 1 


T{A*) is contained in the span of these matrices. 


□ 


Note that is neither 1b nor Ic-generic. The example easily generalizes to higher m, 

e.g. for m = 7 we could take: 


x-\ 


TLeitj{A*) = 


Xl 


Xl 


X2 

xz 

X4^ X7 


Xl 


Xl 


Xl 


X5 Xe X2 

Proposition 5.2. The following tensor: 


XlJ 


'^Leitfi = ai 0 ( 6 i 0 Ci+"' + 6e®C6) + a2®(6i0C2 + &2®C3)+a3®6i®C5+04061 ®C6+ 05064005+ 06064006, 

which gives rise to the abelian subspace: 


fxi 

X2 Xl 




X2 Xl 

Xl 


\ 


X3 X5 Xl 

\X 4 Xg Xl) 


is not End-closed and satisfies g ) = 7 and R(r^gi^ g) = 11. 


Proof. The border rank is at least 7 as is not End-closed. The rank is at least 11 by 

the substitution method. 

To prove that rank is indeed 11 we notice that the 3x3 upper square of q{A*) 


' Xl '' 

X2 Xl 

^ X2 Xlf 


represents a tensor of rank at 

most 4 

by considering: 




/ 

1 \ 


I 

\ 


/ \ 


1 1 

-1\ 




•> 

1 

1 


1 -1 





1 



u 

1 J 


1-1 1 J 


.-1 

1 > 


Apart from this square there are 7 nonzero entries, so the rank is at most 7 + 4 = 11. 

To compute the border rank notice that after removing the second row and column we obtain 
a tensor of border rank 5 by Proposition 16.41 below. On the other hand the entries in the second 
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column and row clearly form a border rank 2 tensor. In other words, the tensor corresponding 
to 


fxi 



X2 

Xy 



X2 

Xl 



Xl 

X3 


Xg Xl 

\X4 


X 6 Xl/ 


has border rank 7 and g is a specialization if it. □ 


5.2. Diag^^ ^ End - Abel a for m> 7. 
Proposition 5.3. The tensor corresponding to 


^Xl 

Xl 





Xl 


Tendj{A*) = 




Xl 



X 2 + Xy 

X3 

X 4 


X2 

X3 

X5 

Xg 


\X4 

X5 

Xg 

Xy 


\ 


Xlf 


is End-closed, but has border rank at least 8 . 


Proof. The fact that it is End-closed follows by inspection. The tensor has border rank at least 
8 by Corollary 12.21 as Tf>nd, 7 {A*) does not intersect the Segre. Indeed, if it intersected Segre we 
would have xi = X 4 - 0, and {x 2 + X 7 )x 2 = 0. If X 2 = 0, then Xj = {x 2 + xj)x 7 = 0, which implies 
X 3 = X 5 = xg = 0 and gives a contradiction. If X 2 + xy = 0 we obtain X 3 = xg = xg = 0. This implies 
xy = 0 and leads to a contradiction. □ 


The following proposition yields families of End-closed tensors of large rank for large m and 
border rank greater than m as soon as m > 8 : 

Proposition 5.4. Let T e A®B®C = be such that T = ai®( 6 i 0 ci h— bm®Cm) + T' 

where T' e A'®B'®C' ■- span{a 2 ,---,am} 0 span{fei,---, 6 [^mj} 0 span{c|'>iL-|,---,Cm}- Then R(T') = 
R(T') + m. 


Proof. We have 


T{A*) c 


^Xi 




Xl 



* Xl 


\ ^ ■ 

* 

Xl 


The lower bound on rank is obtained by substitution method and the upper bound follows as 
rank is sub-additive. □ 


2 

Corollary 5.5. A general element of End- Abel a has border rank at least which is approx¬ 
imately I -of the maximal border rank of a general tensor in C™' 0 C”* 0 C™'. 

Proof. R(r) > R(r') > ^ for general T' e 


□ 
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5.3. A generic A-abelian, End-closed tensor satisfying FT{A*) n Seg{FB x PC) ^ 0 has 
high border rank. 

Proposition 5.6. Let m-1 = k+i with 3 {k+i) < ki+h. Then an abelian tensor T e 
of the form T = M^i) © T' with M^i) e and T' e = A'®B'®C' 

of the form ai®{bi®ci + ■■■ + + T" with T" e general, where = 

span{ 6 i, bk} and = spanjcfc + 1 , Cm-ij, has R(E) > m despite being l^-generic, abelian, 
End-cJosed, and such that PT(A*) n Seg{FB x PC) 0 . 

Proof. Eor general T" the space e C^®C^ will not intersect a 2 (Seg(F^~^ xP^~^)) if 

dimPT"(A*)+dimfj 2 ( 5 'ec/(P^-^xP^-i)) < dimP(C^ 0 CO, i.e., A[2{k+f-2)-l\ + [k+l-T\ < ki-l, 
i.e., if 3{k + f) <kf + b, so T violates the flag condition. □ 

5.4. A tensor in End - Abels of border rank > 8 via Corollary 12.21 Consider (from [33l 
Prop. 19]) 

T"gjf 8 =ai®{bi®ci + ••• + bs'Sics) + a20(l)40C5 + bs®ce) + as®{bs®C5 + b2®ce) + a4®(62®C5 + bi®ce) 
+ 050(64007 + 63003) + 050(63007 + 62003) + 070(62007 + 61003) + 030(61007 + 64005) 


so 


^Xl 

Xl 


^ Lett. 


,8{A1 


X4 

X4 X3 


Xl 

Xl 

X3 X 2 Xl 
X2 Xs Xl 


\ 


Xs X7 Xq X5 Xl 

^Xj X 6 X5 Xij 

Since Pr(A*) n Seg{FB x PC) = 0 , > 8 . In Leitner’s language the bound arises 

because the corresponding group does not contain a one parameter subgroup of rank one. 


5.5. A-abelian tensors that intersect the Segre and fail to satisfy flag condition. The 

following example answers a question about sufficient conditions to be a limit of diagonalizable 
groups in [33l p. 10]. 

Example 5.7. Consider T^g := M^i^ ©T^C^ g e C® 0 C® 0 C® = A®B®C. To keep indices consistent 
with above, write M^i^ = ao®bo®co, so they range from 0 to 8 . Note that TggnSegfF^ xP®xP®) 

0 , and Tgg is lyi-generic and abelian, however R(Tj 9 ) > 9. To see this, note that the flag condition 
fails because there is no P^ contained in a 2 {Seg{F^ x P®)). 


5.6. An End-closed tensor satisfying the flag condition but not the infinitesimal flag 
condition. Consider 


Tflagok{A*) 


<Xi 

Xo Xl 

Xl 




Xl 

Xl 


X4 

X3 

X2 

X4 

X 3 

X2 

Xs 

Xs 

X 7 

Xe 

X5 

[X 7 

xe 

X5 



Xl 


Xl 


Xl 


\ 


Xll 
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Here FTjiagoki^*) i"! Seg{F^ x P®) = [Xq], where Xq is the matrix with 1 in the (2,1) entry and 
zero elsewhere, and 


%„]5eg(pSxp8) 


I* 0 • 

• 0\ 



* 0 • 

■ 0 

0 • 

• 0, 


which only intersects Tfiagok{A*) in [Xq]. Thus by Proposition 12.41 R(r/iagofc) > 9. 

The flag condition is satisfied: consider respectively spaces spanned by xq, X 4,0:3, X2, xs, X7, xe, X5. 
It straightforward to check that Tjiagok is End-closed. 


5.7. 1-generic abelian tensors. In general, the spaces T(A*),T(B*),T(C*) can be very dif¬ 
ferent, e.g. if T is lyi-generic and not l^-generic, or if T is not abelian. The following proposition 
is a variant of remarks in [271 §7.7.2] and [19] : 

Proposition 5.8. Let T e A®B®C = he 1 a Sind 1 b generic and satisfy the A- 

Strassen’s equations. Then T is isomorphic to a tensor in 
In particular: 

(1) After making choices of general a ^ A* and fd e B*, T{A*) and T{B*) are GLm- 
isomorphic subspaces of End(C"*). 

(2) IfT is 1-generic, then T is isomorphic to a tensor in S^C^. 

Proof. Let {ca}, {bj}, {cj} respectively be bases of A,B,C. Write T = Ylf^^^cn^bj^Ck. Possibly 
after a change of basis we may assume = 5jk and Take {a*} the dual basis to {oj} 

and identify T{A*) c End(C™') via . Strassen’s H-equations then say 

0 = [T(a*i),r(a'2)](,,fc) = _^i23i^hik 

i 

Consider when j = 1: 

0 = ^ _ ^hilfilk ^ ^i2hk _ ^hLk vii, *2, A:, 

l 

because and P^^* = But this says T e 5^C™'0C™’. 

Eor the last assertion, say Lb : H H is such that IdA®LB®Idc{T) e S‘^A®C and Lc '■ C ^ A 
is such that IdA®IdB®Lc e S^A®B. Then IdA®LB®Lc{T) is in symmetric in the first 
and second factors as well as the first and third. But S 3 is generated by two transpositions, so 
IdA®LB®Lc{T) e S^A. □ 

Thus the H, H, C-Strassen’s equations, despite being very different modules, when restricted 
to 1-generic tensors, all have the same zero sets. Strassen’s equations in the case of partially 
symmetric tensors were essentially known to Emil Toeplitz [l5], and in the symmetric case to 
Aronhold [3]. 

Proposition 5.9. There exist 1-generic abelian tensors T e that have border 

rank at least , Jjj particular, there exist tensors in satisfying the Strassen- 

Aronhold equations with R(T) > 

Proof. We exhibit a family of 4A:-dimensional subspaces of whose associated tensor can 

degenerate to a general tensor T' e 0 Since the border rank of a general tensor in 
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S^C’^ 0 c C^0C^0C^-1 must satisfy: 

dim a^(^T'){Seg{¥^-^ x x P^'^)) > dimP(S2c^ 0) + 


and dim cJr(S'eg'(P^ ^ x P^ ^ x P^ 2)) = r{3k - 4) + r - 1 (by (S]), we obtain: 


R(r) > R(r') > 


Represent T as a 4A: x 4A: symmetric matrix M with entries that are linear functions of Ak 
variables. The variables will play four different roles, so we name them accordingly: 

( 1 ) variable z, 

( 2 ) variables 

(3) variables xi,..., 

(4) variables ,..., Z 2 k ■ 

They appear in the given order (starting from the top) in the first column of M, ensuring \b- 
genericity. This also defines the last row of M, ensuring Ic-genericity. (Here we order the bases 
of B and C in opposite order to have the matrix symmetric with respect to an anti-diagonal 
reflection.) The matrix M will be lower triangular, with the variable z on the diagonal (ensuring 
l^-genericity), and z appears only on the diagonal. The variables ^i,..., Z 2 k appear only in the 
last row and first column as defined previously. 

Write a general tensor T' e 0 as T' = T,a[jei 0 Cj 0 /;, where a\j = We use T' 
to define the entries in rows 3A: + 1,..., 4A; - 1 and columns k + 1,..., 2k: let 
entry in the {3k + u,k + s)-position. As M is symmetric this defines also the entries in rows 
2A: -I- 1,..., 3fc and columns 2,... ,k. 

Apart from entries defined so far, the only remaining nonzero entries belong to a k x k 
submatrix of rows from 2k + 1,..., 3A: and columns k + 1,..., 2k: the linear form in the y’s 
Zi=i is the {2k + u,k + s)-entry. 

For example, when k = 3, 


T{A*) = 


/ 2 

Vi 

y2 

Xl 

X2 

X3 





El a\i^yi 

El ais^yi 

El 

Z 





^2 

Y,i 0,2iXi 


El 0?2 

El al2yi 

El al^yi 


z 




^3 

T,i afiXi 

EiajiXi 

El ali'-yi 

El ai2yi 

El a^^yi 



z 






Ei a\iXi 

Ei 

Ei aliXi 




z 


^5 



Ei afiXi 

Ei ^iXi 

Ei aliXi 





Z 

\^6 

Z5 

Z4 

^3 

Z2 

Zi 

X3 

X2 

Xl 

y2 

yi 


z! 


To prove that Strassen’s equations are satisfied, take a matrix M in variables as above and 
a matrix M' with primed variables, then it is sufficient to show that each entry of the product 
matrix MM' is symmetric as a bilinear form. This is obvious for: 

(1) a product of any of the first 2k rows of M with any column of M', 

(2) a product of any of the rows 2k + 1,... ,Ak - 1 of M with any of the columns 2,..., 4A: of 

M', 
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(3) a product of the last row of M with column 1 or any of the columns 2/c +1,..., 4/c of M'. 

As all matrices are symmetric it remains to check the assumption for the product of rows 
2A: + 1,..., 4A: - 1 of M and the hrst column of M'. 

For the row 3k + I we obtain the symmetric linear form 

For the row 2k+n we obtain the symmetric linear form O'k+i-n uyi)^u- 

□ 


6 . Tensors of border rank m in 

In this section we present sufficient conditions for tensors to be of minimal border rank and 
determine the ranks of several examples of minimal border rank. 


6.1. Centralizers of a regular element. Let A = B = C = C™. An element x e End(i?) is 
regular if dimC(x) = m, where C(x) := {y e End(i?) | [x,y] = 0} is the centralizer of x. We say 
X is regular semi-simple if x is diagonalizable with distinct eigenvalues. Note that x is regular 
semi-simple if and only if C(x) is diagonalizable. 

The following proposition was communicated to us by L. Manivel. 

Proposition 6.1. Let U c End(i?) be an abelian subspace of dimension m. If there exists 
x e U that is regular, then U lies in the Zariski closure of the diagonalizable m-planes in 
G{m,End{B)), i.e., U e Red{m). More generally, if there exist xi,X 2 e U, such that U is their 
common centralizer, then U e Red{m). 

Proof. Since the Zariski closure of the set of regular semi-simple elements is all of End(i?), for any 
X e End(i?), there exists a curve xt of regular semi-simple elements with limt.^o xt = x. Consider 
the induced curve in the Grassmannian C{xt) c G(m, End(i?)). Then Cq := hmt.^o C{xt) exists 
and is contained in C(x) c End(i?) and since U is abelian, we also have U £ C(x). But if x is 
regular, then dimCo = dim(t/) = m, so limt^oC(xt), Cq and U must be equal and thus U is a 
limit of diagonalizable subspaces. 

The proof of the second statement is similar, as a pair of commuting matrices can be approx¬ 
imated by a pair of diagonalizable commuting matrices and diagonalizable commuting matrices 
are simultaneously diagonalizable, cf. |24t Prop. 4]. □ 

Corollary 6.2. Let T e with dim A <m be such that T{A*) contains an element of 

rank m and, after using it to embed T{A*) c g[^, it is abelian and contains a regular element. 
Then R(r) = m. 

Proposition 6.3. Let T(A* jCa) c s[(B) be the centralizer of a regular element of Jordan type 
(di, dg). Then R(r) = m and R(T) = dj) -Q- In particular, ifT{A*) is the centralizer 

of a regular nilpotent element, then R(r) = 2m - 1 and if it is the centralizer of a regular 
semi-simple element then R(r) = m. 


Proof. It remains to show the second assertion. The substitution method gives the lower bound 
on R(r) for the regular nilpotent case, and Theorem 14.11 gives the lower bound for the general 
case. For the upper bound, it is sufficient to prove the regular nilpotent case. The tensor 
Mc[Z 2 m-i] Equation ([T|)) specializes to T as follows: consider the space cut 

the first rows and the last columns and set all entries appearing above the diagonal in 
the remaining matrix to zero. E.g., when m- 2, 


^Xl X2 xs'' 
X 3 Xi X2 
^X2 X3 Xi, 
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□ 

6.2. The flag algebras of [24] . We answer a question posed in m p. 4/p. 5] whether certain 
algebras derived from flags belong to Red{m). We start by presenting these algebras. Using 
matrix notation, the algebras are given by a partition A of size |A| = m-1, to which we associate a 
Young tableau with entries {x 2 ,---,Xm} whose reflection (across a vertical line for the American 
presentation and across a diagonal line for the French presentation) we situate in the upper 
right hand block of the mx m matrix T{A*) and we fill the diagonal with xi’s. For example 
A = (4,2,1) gives rise to the following 8-dimensional subspace of 

X3 X4 

Xq Xj 
Xg 


xi 

xi 

Xl, 

Call this space the abelian Lie algebra associated to the flag induced by A, and the corre¬ 
sponding tensor in C™'®C™'0C™’ the tensor associated to the flag induced by A. 

Proposition 6.4. The abelian Lie algebras associated to hags, dehned in |24l p. 4/p. 5] belong 
to Red{m), the closure of the diagonalizable algebras. That is, the associated tensors to these 
abelien Lie algebras are of border rank m. 

Proof. For the purposes of this proof, it will be convenient to re-order bases such that the xi’s 
occur on the anti-diagonal, and the Young tableau occur with the American presentation: 

xi 

xi 


Suppose that T{A*) is dehned by a partition A = with |A| = m - 1. We deflne 

m rank 1 matrices, parametrized by e such that T{A*) equals the limit of the span of these 
matrices as e ^ 0, considered as a curve in the Grassmannian G{m,Q\{B)). The matrices will 
belong to hve groups. 

We label the rows and columns of our matrix by 0,-”,m - 1. 

1) The hrst group contains just one matrix with four nonzero entries: 

/I 0 ... 0 

0 ... 0 

2) The second group also contains one matrix, with support contained in the ^(A) x k upper 
left rectangle. For {i,j) in the rectangle, we hll the entry with and set all other entries to 


1x2 Xg X4 X5 
Xq Xj 
Xg 


( 6 ) 


T{A*) 


Vxi 


Xi 


Xi 


Xi 


Xi 


( 5 ) 


T{A*) 


(Xl X2 

Xl 

Xl 

Xl 

Xl 
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zero. So the tensor ([6]) gives 



\ / 


3) The third group contains m - k - i{X) matrices. Each matrix corresponds to an entry in 
the Young diagram A that is neither in the zero-th row or column. Notice that the number of 
such entries equals the number of anti-diagonal entries of the matrix that are not in the first 
k-1 rows or first h) - 1 columns. Fix a bijection between them. To each such entry of the 
Young diagram we associate a rank one matrix with only four nonzero entries. Suppose that 
the entry of the Young diagram is the {io,jo) entry of the matrix and the corresponding entry 
of the anti-diagonal is (ii, ji = m-1- ii). The entries are 


g*o+io 

(i 

J) 

= (*o,jo) 

^m—l 

{i 

,j) 

= (*i, ji) 

gh+io 

{i 

,j) 

= (*i,jo) 

g*o+ii 

{i 

,j) 

= (*0, jl) 

0 


otherwise 


The tensor ([6|) has 

/ \ 


\ / 


4) The fourth group contains k-1 matrices. These correspond to the entries in the 0-th row 
of A but not in the 0-th column. The matrix corresponding to the entry in the i-th column is 
defined by 


^m-1 

0 


j = 0 

j < k - 1 and {i,j) Young diagram of A 
aj'~^~^h.as been associated to a* 
j = m - 1 - i 
otherwise 
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The tensor ([6]) has 
/ el 


\ / 



\ 


e 


7 


/ 


/ 


5) The fifth group, consisting of ^(A) - 1 matrices, is analogous to the fourth with entries 
corresponding to rows instead of columns and all entries, apart from the first column, in the 
^(A) X k upper left rectangle equal to zero. 

The tensor ([6|) has 


/ 



\ 


e 


7 


\ 


/ 


Except for the second group, each matrix in each group has a distinguished element in the Young 
diagram which, after normalization, is the limit as e ->■ 0. Moreover, summing all matrices from 
groups 1,3,4,5 and subtracting the matrix from group 2, the limit as e ^ 0 is the identity 
matrix. □ 


6.3. Case m = 4. Fix an 74-concise, l^i-generic border rank 4 tensor T € A ® B ® C, where 
A,B,C - C^. The contraction T(A*) is a 4-dimensional subspace of matrices and we may 
assume that it contains the identity. By |24l Prop. 18] we may assume that the space T{A*) is 
one of the 14 types of [2U §3.1], corresponding to orbits of PGL^. We consider tensors up to 
isomorphism. 

• One-regular algebras - centralizers of regular elements. There are 5 types, their ranks 
are provided by Proposition 16.31 These are Oi 2 ,Oii,Oio',Oio",O q in [231 §3-1]. 

• Containing a (3,1) Jordan type non-regular element. There are two types, giving rise to 
isomorphic rank 6 tensors. Set theoretically, the intersection with the Segre variety is a 
line and a point. 


Tcj" O' 

Wg ,i.^g 


Y 0 a 0^ 
0 c 6 0 
0 0 c 0 
^0 0 0 d/ 
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• Containing a nilpotent element with Jordan block size 3. There are three types, all 
of rank 7, the first one representing a class to which the Coppersmith-Winograd ten¬ 
sor T 2 ,cve belongs, see ^7.21 In the second case the intersection with the Segre set- 
theoretically is a line. 


Tos = T2 ,cw = 



b 

a 

d\ 


' c 

h 

a 

0 \ 

0 

c 

b 

0 

) To'^,o'^ = 

0 

c 

b 

0 

0 

0 

c 

0 

0 

0 

c 

0 

\o 

0 

d 

c) 


lo 

0 

d 

cy 


• Four types, all of rank 7, giving rise to three different types of tensors. Set-theoretically 
the intersection with the Segre is, in the first case two lines intersecting in a point, in 
the second case a smooth quadric, in the third case a plane. 


Toq = 


0 a 

0 c 0 d 
0 0 c 0 

0 0 Cy 


(c 0 a d\ 


Toj = 


0 c b a 

0 0 c 0 

^^0 0 0 Cy 


T. 


O' O'' 


a b d^ 
0 c 0 0 
0 0 c 0 

^0 0 0 C) 


6.4. Case m = 5. As remarked in |24] . it is sufficient to consider nilpotent subspaces as others 
are built out of them, so we restrict our attention to them. Up to transpositions the following 
are the only maximal, nilpotent. End-abelian 5-dimensional subalgebras of the algebra of 5 x 5 
matrices. We prove that each of them is in Red{5). Notation is such that T]s^^■ corresponds to 
the nilpotent algebras Ni,Nj of [44], and we slightly abuse notation, identifying the tensor with 
its corresponding linear space. 


fa 

0 

0 

0 

0\ 


fa 

0 

0 

0 

0\ 

b 

a 

0 

0 

0 


b 

a 

0 

e 

0 

c 

0 

a 

0 

0 

00 

II 

c 

b 

a 

d 

e 

d 

0 

0 

a 

0 

0 

0 

0 

a 

0 

\e 

0 

0 

0 

ay 


U 

0 

0 

0 

ay 


Tnj 


/a 0 0 0 0\ 

b a 0 d 0 

c b a e d 

0 0 0 a 0 

^0 0 0 6 Oy 


fa 

0 

0 

0 

0\ 


fa 

b 

a 

0 

0 

0 


b 

c 

b 

a 

0 

0 

) ^Afll,l3 - 

c 

d 

0 

0 

a 

0 

d 


0 

0 

0 

ay 




fa 

0 

0 

0 

0\ 


fa 

0 

b 

a 

0 

0 

0 


b 

a 

c 

b 

a 

0 

0 

) Tnis = 

c 

b 

d 

c 

b 

a 

0 


d 

c 

\e 

0 

0 

0 

ay 


u 

0 


0 

0 

0 

0\ 





fa 

0 

a 

0 

0 

0 





b 

a 

b 

a 

d 

0 

II 

n, 

cw 

= 

c 

b 

0 

0 

a 

0 





d 

0 

0 

0 

0 

ay 





kg 

0 

0 

0 

0\ 


fa 

0 

0 

0 

0\ 


0 

0 

0 


b 

a 

0 

0 

0 


a 

0 

0 

II 

c 

b 

a 

0 

0 


b 

a 

e 


d 

c 

b 

a 

e 


0 

0 

ay 


lo 

0 

0 

0 

ay 



0 0 0\ 
0 0 0 
a d e 
0 a 0 
0 0 ay 


is obviously of border rank five. For T]\f^ and (resp. T]\f^g) apply Propo¬ 
sition ED to a pair of matrices represented by b and e (resp. b,d). ^2 limit as e ^ 0 of 

the space spanned by the following five matrices: 


/o 

0 

0 

0 

o\ 


(0 

0 

0 

0 

0 \ 


/o 

0 

0 

0 

o\ 


/o 

0 

0 

0 

0 \ 


/e2 

-e^ 

e6 

0 

o\ 

e e2 

0 

0 

0 


0 

0 

0 

0 

0 


0 

0 

0 

0 

0 


0 

0 

0 

0 

0 


-e 


-e^ 

0 

0 

1 e 

0 

0 

0 


0 

0 

0 

0 

0 


0 

0 

0 

0 

0 


1 

0 

0 

0 

0 


e-2 

-e 

e2 

0 

0 

0 

0 

0 

0 

0 


1 

0 

0 e2 

0 


0 

0 

0 

0 

0 


0 

0 

0 

0 

0 


-1 

e3 

-e^ 

0 

0 

\^0 0 

0 

0 

Oyl 


\0 

0 

0 

0 

Oyl 


u 

0 

0 

0 


lo 

0 

0 

0 

Oyl 


1-1 

e3 

-e^ 

0 

0/ 
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Tni 

1,13 

is the limit of the space spanned by 



/O 

0 

0 

0 

0 \ 


/ 0 

0 

0 

0 

o\ 


/O 

0 

0 

e 


0 

0 

0 


0 

0 

0 

0 

0 


0 

0 

0 

1 

e 

0 

0 

0 

5 

e-3 

0 

0 

1 

0 

5 

0 

0 

0 

0 

0 

0 

0 

0 


1 

0 

0 

e3 

0 


0 

0 

0 

\0 

0 

0 

0 

0 ) 


1 0 

0 

0 

0 



u 

0 

0 


0\ 


/o 

0 

0 

0 

0\ 



-e^ 

6 ® 

-e" 

o\ 

0 


0 

0 

0 

0 

0 


-e 

e" 

- 6 ^ 

e3 

0 

0 

1 

1 

0 

0 

0 

0 

1 

e -2 

-e 


-1 

0 

0 


0 

0 

0 

0 

0 


-1 


-e^ 


0 



lo 

0 

0 

0 

oj 


1-1 


-e^ 


0/ 


Tjvi 4 is isomorphic to the Coppersmith-Winograd tensor. We determine the rank of each tensor. 

The following conjecture was presented at the 2011 Algebraic geometry with a view to appli¬ 
cations semester at the Mittag-Leffler institute; 

Conjecture 6.5 (J. Rhodes). [U Conjecture 0] The maximal rank of a tensor in 
of border rank m is 2m - 1. 

This conjecture was known to be true classically for m = 1,2 and verified in [3] for m - 3. 
Above we verified it for m = 4. The following proposition shows that the conjecture is false for 
m > 4: 


Proposition 6.6. 

= R-(^Nio,i2) = R-(^Wi,i3) = = 9 

and 

= 10 - 

Proof. The fact that the rank of any tensor is at least 9 follows by the substitution method. To 
see that R(Tjv 6 g) > 10, first apply Proposition 13.11 to the first and fourth row and to the third 
and fifth column. This shows that the rank is at least 4 plus the rank of the tensor associated 
to 

I b 0 e ^ 

c + ae b + (de d + 'je , 

\ e 0 

where a ,/?,7 are some constants. Now apply the proposition to the second column obtaining a 
tensor represented by 

/ 6 e '' 

c + ae + 5b d + ^e + pb , 

\ e 0 / 

where 6,p,a,^ are (possibly new) constants. This space is equal to 

'b e'' 
c d 

\e 0 / 

and it remains to show that it corresponds to a tensor of rank at least 5. This follows by 
Proposition 13.11 by first reducing b, c, d and obtaining a rank 2 matrix. 

To prove that > 10, apply Proposition 13.11 and remove the second, third and fifth 

column and first and fourth row to obtain a tensor isomorphic to 

jb d\ 
c e , 

\0 b) 

and conclude as above. 

The upper bounds for ranks of 42 ) and T 7 V 17 follow from Proposition 16.31 

For TTVgg, consider: 
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(1) 5 matrices, including the matrix corresponding to c, which follow from Proposition 16.31 
for the upper left 3x3 corner, 

( 2 ) 2 matrices for last 2 diagonal entries, 

(3) 1 matrix corresponding to d, 

(4) the 2 matrices: 


/o 

0 

0 

0 

0\ 


/o 

0 

0 

0 

0\ 

0 

0 

0 

1 

0 


0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

1 

1 

0 

0 

0 

1 

0 

0 

0 

0 

0 


0 

0 

0 

0 

0 

\0 

0 

0 

0 

oj 


u 

0 

0 

0 

1/ 


For T/Vii 13 it is enough to notice that once a matrix for c and the fourth diagonal entry are 
given, one can generate the matrix corresponding to d using 

/O 0 0 0 0\ 

0 0 0 0 0 

10 0 10 . 

10 0 10 
\0 0 0 0 Oy 

An analogous method shows R(r 7 Vis) “ 9. The tensor is a special case of Proposition 17.11 
For consider 3 rank one matrices corresponding to entries of the first column, 2 rank 

one matrices corresponding to the third and fourth diagonal entry and one matrix corresponding 
to e. Apart from these six matrices we are left with the tensor represented by 

'a d 0 ^ 

6 0 d . 

^0 b 

This tensor is isomorphic to the symmetric tensor given by the monomial xyz which has Waring 
rank 4, see, e.g., [3T] (the upper bound dates back at least to [E]), and thus tensor rank at most 
4. □ 

Apart from the nilpotent algebras just discussed there are two families of End-closed 5- 
dimensional subalgebras. 

(1) The subspace spanned by identity and any 4-dimensional subspace of the 6 -dimensional 
algebra 


/o 

0 

0 

0 

0\ 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

a 

b 

0 

0 

0 

\d 

e 

/ 

0 

0/ 


In this case there are normal forms: Tensors in A'®B'®C' = C^ 0 C^< 8 iC^ are classified 
in m- We have T - ai{bici + .. + b 5 C 5 ) + a2biC4 + a 3 biC 5 + a4b2Ci + a 5 b 2 C 5 + aeb 3 Ci + aYb 3 C 5 = 
ai{bici -H .. -H 65 C 5 ) + T' where 02 , ..07 satisfy two linear relations. If we make a change of 
basis in C4, C5, say by a 2 x 2 matrix X, then as long as we change 64,65 by X~^ the first 
term does not change. Similarly, if we make a change of basis in bi,b 2 ,b 3 , by a matrix 
T, then as long as we change ci, 02,03 by , the first term does not change. In our 
case we may assume the tensors are A-concise. There are the following cases (numbers 
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as in m), we abuse notation, writing T for T(A*): 



<Xl '' 


fxi '' 


fxi '' 


Xl 


Xl 


Xl 

II 

Xl 

II 

Xl 

T20 = 

Xl 


X2 X3 Xl 


X 2 X3 X5 Xl 


X2 Xl X5 Xl 



fxi 

Xl 



<Xi 

Xl 




<Xl 

Xl 


T21 = 



Xl 

,222 = 



Xl 


, T23 = 



Xl 


X 2 

Xl 

X5 Xl 


X 2 

Xl 

Xl 



X 2 

X 3 

Xl Xl 


U3 

X 5 

Xl) 


U3 


X 5 

Xl) 


U3 

Xl 

X5 Xl) 


Now R(r 9 ) = R(T 2 o) = 5 because they are special cases of flag-algebra tensors - cf. Propo¬ 
sition 16.41 

T 22 {A*) is the limit of the space spanned by the following 5 matrices: 




\1 


6 ^ / 


-e 


eV 


\ 


/ 


/ 


\ 




I 


\ 




I 


1 

VI 


T 2 ‘i{A*) is the limit of the space spanned by the following 5 matrices: 


- 2 e® 


V -2e^ 1 






_lg8 

2 

2^ 


-2 


V 


/ 


/ 


2 e^ 


1 e 2e^ 

\ e e 2 2e3 


/ 


/ 


2 e^ 

V l + 2e^ 




! 


1 -e 
\-e 


P 2 i(^’^) is the limit of the space spanned by the following 5 matrices: 

/ \ / \ /e^ 


^3 ^4 

€ £2 
\ £2 £3 


/ 


V 


/ 


£® £* \ 


-£2 £4 


\ 


/ 


\ 


/ 


? 

1 

-£2 -£3 e'^) 


u 


Ti 9 ( 74 *') is the limit of the space spanned by the following 5 matrices: 


/e^ 


-£ 


-£ £ 


/ 


/ 


£ 

£ 


/ 


/ 


V 1 


eV 


/ 


1 1 
VI 1 


/ 


/ 


-1 1 

V 1 -1 


/ 


Proposition 6.7. R(r 2 i) = 10 and all other tensors on this list have R(Tj) = 9- 


Proof. This follows by the substitution-method and considering the ranks of T' in |10] . 

□ 
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(2) The subspace spanned by the identity and any 4-diniensional subspace of the 5-dimensional 
algebra 


(7) 


/O 0 0 0 0\ 

a 0 0 0 0 

6 a 0 e 0 

0 0 0 0 0 

0 0 C Oy 


All the operations we will perform preserve the identity matrix. 
First, by exchanging rows and columns the algebra is 


/O 0 0 0 0\ 

0 0 0 0 0 

a 0 0 0 0 . 

d c 0 0 0 

e a 0 0/ 

Note that the tensor TLeit ,5 of Proposition 15 .1 1 is in this family (set 6 = 0). 

Proposition 6.8. All End-closed tensors in obtained from ^-dimensional subspaces 

of ([7|) have border rank five. 

To prove the proposition, we will use the following lemma: 

Lemma 6.9. Each of the tensors in corresponding to linear spaces spanned by the 

identity and the following subspaces have border rank 5; 


5i = 


/o 

0 

0 

0 

0\ 


/o 

0 

0 

0 

0\ 


/o 

0 

0 

0 

0\ 


(0 

0 

0 

0 

0\ 

0 

0 

0 

0 

0 


0 

0 

0 

0 

0 


0 

0 

0 

0 

0 


0 

0 

0 

0 

0 

a 

0 

0 

0 

0 

,52 = 

a 

0 

0 

0 

0 

,53 = 

a 

0 

0 

0 

0 

,54 = 

a 

0 

0 

0 

0 

d 

0 

0 

0 

0 


d 

a 

0 

0 

0 


d 

e 

0 

0 

0 


d 

e 

0 

0 

0 

\h 

e 

a 

0 

oj 


U 

e 

a 

0 

oj 


U 

0 

a 

0 

0/ 


\b 

d 

a 

0 

0 ) 


The tensors corresponding to Si,S 3 ,S 4 , have rank 9 and the tensor corresponding to S 2 has 
rank 10. 


Proof. We first prove the statement about the border rank. The span of Si and the identity is 
the limit of the space spanned by 


(0 

0 

0 

0 

o\ 


(e^ 

0 

4^^ 

0 


2 ^ 

\ 


/O 

0 

0 

0 

0^ 

0 

0 

0 

0 

0 


0 

0 

0 

0 


0 



0 

0 

0 

0 

0 

e 

0 


0 

0 


-e 

0 

1 

2 


0 


-lg3 

2^ 


? 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 


0 

0 

0 

0 


0 



e 

4 

0 

e2 

0 

\2 

0 

e 

0 

0 ) 


1 2 

0 


-e 

0 


e2 



lo 

0 

0 

0 

0/ 





(0 

0 

0 

0 

o\ 


/o 

0 

0 


0 

0^ 









0 

e2 

0 

0 

0 


0 

0 

0 


0 

0 









0 

0 

0 

0 

0 

5 

0 

0 

0 


0 

0 









0 

0 

0 

0 

0 


e 

4 

0 


0 

0 









lo 

e 

0 

0 

oj 


u 

e 

0 


0 

oj 
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For So, consider 




/e" 

0 


0 

e«\ 



/ 0 

0 

0 

0 

Oi 


/ 0 

0 

0 

0 

o\ 

0 

0 

0 

0 

0 



a/ 3 e^ 


0 


0 


0 

0 

0 

0 

0 

e2 

0 


0 


1 

A2 = 


0 

0 

0 

0 

0 

, ^3 = 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 



e 


0 

/ 3 e 4 

0 


e 

l-g 2 

OL 

0 

0 

0 

\1 

0 


0 

eV 



^ a 

e 

0 

a/ 3 e^ 

oy 


A + a 

e 

0 

0 

0/ 

/o 


0 

0 


0 

o'\ 


{ 0 

0 

0 0 

0^ 






0 


0 

0 


0 

0 



0 

0 0 

0 







X4 


0 

0 

ae^ 


,^5 


0 


0 

0 

0 / 


where in order that X3 has rank one, take a to be a solution of the equation + a - 1 = 0 . We 
determine /3 later. 

First note that the limits as e goes to zero of 

-X^jXi, -X4 
€ € 

give matrices corresponding respectively to d,b,e. 

Consider Xi + X2 - X3. The constant terms and the terms of order e add to zero. The ( 4 , 2 ) 
entry equals 

a a 

Hence, the limit gives the matrix corresponding to a. 

It remains to prove that the identity matrix belongs to the limit. For this we consider 


1 


+ -(X2 - - 
1 2 1 


1 


■ a 


-X3)-X4-X5. 


As is on the diagonal it remains to prove that the lower order terms all add to zero. For the 
constant term 

^ a 1 + a - a) + a - - 1 - a 

(5 (5{1 - a) f5{l - a) ’ 

the numerator equals / 5(1 - a) - - 1 , so we take /3 = to make it zero. To see that the 

terms proportional to e cancel, observe that 

-(1- 3 —) =- - -. 

/3 1 - a / 3 (a - 1) 

All three of the terms proportional to cancel, the only nontrivial being 

1 _1 l-g 

a 1- a a 


The term proportional to also cancels out. 

The span of and the identity is the limit of the space spanned by 


/o 

0 

0 

0 

o\ 


(e^ 

0 

2 

0 

2 


/O 

0 

0 

0 

o\ 

0 

0 

0 

0 

0 


0 

0 

0 

0 

0 


0 

0 

0 

0 

0 

-e 

0 


0 

0 

? 

e 

0 

2^ 

0 

lg3 

2 ^ 

5 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 


0 

0 

0 

0 

0 


1 

-e 

0 


0 

\2 

0 

-e 

0 



U 

0 

e 

0 



lo 

0 

0 

0 

0 / 
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/O 0 0 0 0\ 
0 0 0 0 
0 0 0 0 0 
0 e 0 0 0 
\0 0 0 0 Oy 


/O 0 0 0 0\ 

0 0 0 0 0 

0 0 0 0 0 

1 0 0 0 0 

\4 0 0 0 Oy 


The span of ^4 and the identity is the limit of the space spanned by 


/o 

0 

0 

0 

0\ 


(e^ 


0 

0 



/O 

0 

0 

0 

o\ 

0 

0 

0 

0 

0 


0 

0 

0 

0 

0 


0 

0 

0 

0 

0 

0 

0 

0 

0 

0 


0 

0 

0 

0 

0 

? 


0 


0 

0 

0 

0 

0 

0 

0 




0 

0 



0 

0 

0 

0 

0 

\1 

0 

0 

0 

oj 


U 


0 

0 



U 

0 


0 

0/ 



/o 

0 

0 

0 

o\ 


/ 0 

0 

0 

0 

o\ 





0 


0 

-e® 

0 


0 

0 

0 

0 

0 





0 

0 

0 

0 

0 


-e3 


6^ 

0 

0 





0 

-e^ 

0 


0 


-e2 



0 

0 





lo 

0 

0 

0 

0) 



-e 

2 

-e3 

0 

0) 




The lower bounds for rank follow by substitution method. For rank upper bounds, consider 
the seven rank one matrices: 


( 1 ) 4 matrices corresponding to first two and last two entries of the diagonal, 

(2) 1 matrix corresponding to b, 

( 3 ) the 2 matrices: 


0 

0 

0 

0 

0\ 


/o 

0 

0 

0 

0\ 

0 

0 

0 

0 

0 


0 

0 

0 

0 

0 

-1 

0 

1 

0 

0 

? 

1 

0 

1 

0 

0 

0 

0 

0 

0 

0 


0 

0 

0 

0 

0 

1 

0 

-1 

0 

0 


u 

0 

1 

0 

0/ 


In all four cases it is easy to find the remaining rank 1 matrices. □ 


Proof of Proposition \6.^ If the subspace is given by a = 0 then we conclude by Proposition 
lOl Otherwise there exists a matrix Mi in the algebra with the entries corresponding to a 
nonzero. We may assume that the 3 other generators of the algebra M2,M3,M4 have entries 
corresponding to a equal to zero. Further, we may assume that M2 has only one entry nonzero, 
corresponding to 6, as otherwise, by considering M^ the algebra would not be End-closed. Hence 
we may assume that M3 and M4 have only nonzero entries on d, c and e. 

Let S denote the 3 -dimensional vector space corresponding to d, c and e, and let S' c 5 be 
the two-dimensional subspace spanned by M3 and M4. 

Case 1 ) S = {M e S | c = 0 }. We may assume that M3 corresponds to e, M4 corresponds to d 
and the algebra is given by 


(0 

0 

0 

0 

0\ 

0 

0 

0 

0 

0 

a 

0 

0 

0 

0 

d 

Xa 

0 

0 

0 

[b 

e 

a 

0 

0) 


for some constant A. If A = 0 we are in case Si. Otherwise, by multiplying second column by 
1 /A and second row by A we may assume that A = 1 and are in case S2. 

Case 2 ) S = {M e S | e = 0 }. Subtract any multiple of the third column from the second 
column, and add the same multiplicity of the second row to the third row to reduce to case S3. 
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Case 3 ) S' = {M e S | d = 0 }. This is analogous to Case 2). 

Case 4 ) As we are not in case 2) or 3 ) we may assume there are constants A e C, and < 5^0 
such that 


S = 


/O 

0 

0 

d 


\0 


0 0 

0 0 

0 0 

\d + 5 e 0 

e 0 


0 0\ 
0 0 
0 0 
0 0 
0 Oy 


Then we may assume that Mi represents the space 


/O 0 0 0 0\ 

0 0 0 0 0 

a 0 0 0 0 

0 0 0 0 0 

^0 pa a 0 Oy 


Subtract p times the third column from the second column, and add p times the second row to 
third row, reducing to p = 0 . At this point we have the algebra 


/O 0 0 0 0\ 

0 0 0 0 0 

a 0 0 0 0 

d Xd + 6e 0 0 0 

^6 e a 0 Oy 


Subtract 1/5 times the fourth row from the fifth row and add 1/5 times the fifth column to the 
fourth column to obtain a subspace isomorphic to 


/O 0 0 0 0\ 

0 0 0 0 0 

a 0 0 0 0 

d e 0 0 0 

-jd a 0 Oy 


If A = 0 we are in Case 2). If A 0 we multiply the second column by -j and the second row by 
to reduce to case S4. □ 


6.5. Examples with large gaps between rank and border rank. First consider 

Tgap = Oi 0(610Ci + '"+66®C6)+a2®66®Ci+a30(650Ci+66®C3)+a4®65®C2+a5064®C3+a6® (64^02+65003), 

i.e.. 


fXl 

Xl 

Xl 



Xq 

X 5 Xl 


X3 

X 4 

Xq 

Xl 

\X 2 


X3 

XlJ 


Tgap{A*) = 


Note Tqap is neither 1 b nor Ic-generic. In the following proposition we show that T„ap is also a 


counterexample to [H Conjecture 0 ]. 

Proposition 6.10. R(Tgap) = 6 and H{Tgap) = 12 . 
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Proof. To prove that Ti{Tgap) = 12 , by the substitution method, it suffices to prove that R(r') 
6, where T' corresponds to the subspace 


X3 

^X2 


xe 

X 4 


Xs'' 

Xq 

X 3 / 


This space is contained in the space spanned by the following 6 rank one matrices; 


( 1 ) 

( 2 ) 

( 3 ) 


3 matrices corresponding to X2,X4,X5, 
2 matrices corresponding to xq , 
the matrix 


/ 


1 

1/ 


Were T' of rank 5 , then the space would be equal to the space generated by five rank one 
matrices. However, each rank one matrix in this space has X3 = 0 . This finishes the proof that 
R(Tgap) = 12 . It remains to prove R{Tgap) = 6. As Tgap is A-concise we only need to prove 
R(Tg(jp) < 6. Consider the following 6 rank one matrices: 


/ 


\l 


/ 


/g5 ^9 


1 


/ \ 
/ 


/ 


.-10 


1 


-e 


-e 


-e 

e8 


10 


□ 


So far all the tensors we considered had rank less than or equal to twice the border rank. By 
[ 7 ] the maximal rank of a tensor is at most twice the maximal border rank, and all previously 
known examples of tensors had rank at most twice the border rank. The following example goes 
beyond this ratio. 

For T e A®B®C and T' e , consider A®A' as a single vector space and similarly 

for B®B' and C®C'. Define T®T' e (A®A')®(B®B')®(C®C'). In what follows, we will use a 
tensor T' e to produce three copies of Tgap. 

Proposition 6.11. The tensor 

Tbiggap ■= Tgap O (ei ® fi ® gi + 62 <® (/2 <® Ql + fl ® 92)) ^ 
has border rank 12 and rank at least 25 . 


Proof. Tbiggap has border rank 12 as it is the tensor product of concise tensors of border rank 6 
and 2 . In terms of matrices. 


n„{A*®c^*) 


(Tgap{A*) Tgap{A*) 

\Tgap{A*) 
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where A* is another copy of A*. Denote the vectors in T{A*) with primes. Eliminate xi,x'^ by 
the substitution method so that Tbiggap has border rank at least 9 plus the rank of the tensor 
T e represented by 

('0 xe X5 0 Xg x'^\ 

X 3 X4 Xq Xg X4 Xg 

X2 0 X3 X2 0 X3 

0 Xg Xg 0 0 O' 

X3 X4 Xg 0 0 0 

^X 2 0 X 3 0 0 0 y 

We now prove R(T) > 13 . Write T = X2®M2 + "- + Xg®Mg. Apply Proposition 13 .II hrst with X2 to 
get a tensor = X30{M3-X3M2)+ --- + Xq^{Mq-XqM2) with < R(T)-1. Continue in 

this manner, eliminating all but Xg to get a tensor = X3®(M3+C2M2+-" + c'M') 6C1®C6®C6 
where the Cj,Cj are some constants. 

Hence R(T') > 9 + R(T'(®^). But R(T^®^) is simply the (usual) rank of the matrix 


/o 

C 6 

C 5 

0 

4 

4\ 

C3 

C4 

C6 

1 

4 

4 

C2 

0 

C3 

4 

0 

1 

0 

ce 

C 5 

0 

0 

0 

1 

C 4 

4 

0 

0 

0 

\C2 

0 

1 

0 

0 

0/ 


It remains to show that rank(M3) > 4 . Suppose to the contrary that all the 4 x 4 minors of M3 
are zero. One of the minors equals (1 - c^Cg)^, hence we would need C2,Cg ^ 0 . There is also a 
minor (c^Cg)^, which would force Cg = 0 . However, there is also the minor (C4C5 - Cg^)^ which 
under these assumptions cannot be zero. We conclude R(T') > 12 + 9 + 4 = 25 . □ 


By further tensoring Tgap analogously as above, we obtain tensors with rank to border rank 
ratio converging at least to 13 / 6 . 

The following tensor is a generalization of S2 of Lemma 16.91 which is the case Tbiggap,^■ 
Theorem 6.12. Let m = 2 k + 1 . Let T e be the tensor represented by 


< Xo 

0 

0 

0 

o\ 


Xl 

Xo 

0 

0 

0 


X2 

0 

Xo 

0 

0 


^k-1 

0 

0 

Xo 

0 


Xk 

^k+1 

Xk+2 ■ 

• X2k-1 

Xq) 


be the tensor such that Tbiggap, 

m{A*) 


Let Tbiggap,m ^ be the tensor such that Tbiggap,mi^*) ttas T{C'^~^*) in its lower 

left {k + 1 ) X (k + 1 ) corner and X2k along the diagonal. Then m < R{Tbiggap,m) < m + 1 and 
^{Tbiggap,m) = |(m-l). In particular the ratio of rank to border rank tends to | as m 00. 


Proof. It is straightforward that R(T) = 3 k. By the substitution method Li{Tbiggap,m) > 2 k + 
R(T) = 5 k and in fact equality holds. 

To estimate the border rank, fix bases {oj} of A, {bj} of B and {cj} of C so that T belongs to 
the subspace spanjui,..., am-i}®span{6fc+i,..., 6m}®span{ei,..., ek+i}. Consider the following 
m rank 1 elements of B®C: 

(1) {2bm + ebk+i + €^61)0(01 + ^ecfc+i + \e^Cra), 
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( 2 ) ( 26 ^ - ebk+i + e‘^bi)0{ci - ^eck+i + 

( 3 ) (^fc+i + ■'' + bjTi—i + 26 m)®Cl) 

(4) 6m®(2ci +C2 +-" + Cfc), 

(5) 6j0(ci + ecj_fc+i + e^Ci) for i = /c + 2,..., m - 1, 

(6) (6m - ebk+i + e^bi)®Ci for i = 2,..., fc. 

The rank one elements of T(C”*“^*) are obtained from 5) and 6). The diagonal of T(C™'“^*) 
is obtained by adding all elements of 5) with 1) and subtracting 3). The identity matrix is 
obtained by adding all elements of 5) and 6) with 1) and 2) and subtracting 3) and 4). □ 

Remark 6.13. After we posted a preprint of this article on the arXiv, Jeroen Zuiddam shared 
with us his forthcoming article (now |48j i presenting an example of a sequence of tensors with 
rank to border rank ratio approaching three. 

Question 6.14. Is the ratio of rank to border rank unbounded? Can one find explicit tensors 
with ratio 3 or larger? 

In this context we recall the following problem, which is a variant of our question in the 
situation of minimal border rank: 

Problem 6.15. [U Open problem 4.1] Is there an explicit family of tensors Tm e C™0C'”0C”^ 
with R(Tm) > (3 + e)m for some e > 0? Can we even achieve this for tensors corresponding to 
the multiplication in an algebra, i.e., is there an explicit family of algebras Am with R(.Am) ^ 
(3 + e) dim .Am for some e > 0? 

For tensors T e Ai0---0 A„, there are tensors of rank n - 1 of border rank two. 

6.6. There are parameters worth of non-isomorphic 1-generic border rank m tensors 

in C™'0C™'0C™'. Let r € Matp^n- Set m = n + p + 1. Define 

p n n 

■— fli®(6i0ci + • ■ •'Sibp+Yi+i'SiCp+n+i') + ^ c:i+j 06 j 0 (^ t. j,sCp+l+s) + eiip+l+s^'P+lCp+l+s 

j=l S=1 S=1 

Leitner [33] shows that ^{TLeit,T) = en and that the family gives non-isomorphic tensors for 
p > 4, n > 2, i.e., m>7. 

Remark 6.16. Leitner only shows the border rank condition under certain genericity hypotheses 
on r, but from the border rank perspective they are unnecessary by taking limits. (Border rank 
is semi-continuous.) 

In particular, when p = 4, ri = 2 Leitner shows that there is a one-parameter family of non¬ 
isomorphic subgroups of that are limits under conjugacy of the torus. The same argument 

shows that there is a corresponding one-parameter family of non-isomorphic tensors. 

7. COPPERSMITH-WiNOGRAD VALUE 

As mentioned in the introduction, a motivation for this article is the study of upper bounds for 

the exponent of matrix multiplication. For our purposes, the exponent ui of matrix multiplication, 

2 2 2 

which governs the complexity of the matrix multiplication tensor ^ <8>C^ 0C"' , may be 

defined as 

cu := infjr e M | R(M^n^) = 0(n'^)}. 

Naively one has cu < 3 and it is generally conjectured by computer scientists that cu = 2. 

The “proper” way to determine the exponent of matrix multiplication would be to determine 
the border rank of the matrix multiplication tensor. Unfortunately, this appears to be beyond 
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our current capabilities. Thanks to a considerable amount of work, most notably [381 ITTl I 16 j . 
one can prove upper bounds for matrix multiplication by considering other tensors. 

First, Schonhage’s asymptotic sum inequality [ 38 ] states that for all lj,mj,nj, with 1 < i < s, 

^(minili)t 1^)). 

i=l i=l 

Then Strassen [JT] pointed out that it would be sufficient to find upper bounds on the border 
rank of a tensor that degenerated into a disjoint sum of matrix multiplication tensors. This was 
exploited most successfully by Coppersmith and Winograd m, who attained their success with 
a tensor Tew- The purpose of this section is to isolate geometric aspects of this tensor in the 
hope of finding other tensors that would enable further upper bounds on the exponent. 

In practice, only tensors of minimal, or near minimal border rank have been used to prove 
upper bounds on the exponent. Call a tensor T that gives a “good” upper bound for the 
exponent via the methods of mi ESI, of high Coppersmith-Winograd value or high CW-value for 
short. More precisely, T has high Coppersmith-Winograd value if the quantity Valp{T®^) as 
dehned in jS] p. 8] is large for some k. We briefly review tensors that have been utilized. Our 
study is incomplete because the CW-value of a tensor also depends on its presentation, and in 
different bases a tensor can have quite different CW-values. Moreover, even determining the 
value in a given presentation still involves some “art” in the choice of a good decomposition, 
choosing the correct tensor power, estimating the value and probability of each block | 46 j . 

7 . 1 . Schdnhage’s tensors. Schonhage’s tensors are Tgch = where N = (m- 

l)(n-l). Here ^{Tsch) = N +1 while Il{Tsch) = N+mn - 2R(T5c/i)-(m+n-l). It gives uj < 2 . 55 . 
There is nothing to gain by taking tensor powers here because the two matrix multiplications 
are already disjoint. 


7.2. The Coppersmith-Winograd tensors. Coppersmith and Winograd define two tensors: 


g 

(8) Tq^cw ■= E aQ®hj®Cj + aj<S>bo®Cj + aj<S>bj<S>co e 

f=i 

and 

( 9 ) 

g 

Tq^cw ■- '^{ao®bj®Cj+aj®bo®Cj+aj®bj®co)+ao®bo®Cq+i+ao®bq+i®co+aq+i®bo®co e C'^’'’^0C'^'''^0C'^'''^ 
1=1 


both of which have border rank q +2. 
In terms of matrices. 


Tq,cw{C*) 


f 0 Xi ■■■ 
Xi Xq 0 
X2 0 Xq 


Xq^ 


and 


\Xq 0 ■■■ 0 Xq) 


Tg,cw(cn 


'Xq+l 

Xl 


Xq 

3^0 \ 

Xl 

Xo 

0 


0 

X2 

0 

Xo 



Xq 

0 


o 

■' o 


xq 

0 


0 

0/ 
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Permuting bases, we may also write 

0 


xo 

Xq XoJ 

Proof. We first prove the lower bound for Tq^cw- Apply Proposition 13.11 to show that the rank 
of the tensor is at least 2 q-2 plus the rank of 

0 

Xq XiJ’ 

which has rank 3 . An analogous estimate provides the lower bound for R(Tq^cw)- To show that 
^{Tq^cw) <2(7 + 1 consider the following rank 1 matrices, whose span contains T{A*)\ 

1 ) g + 1 matrices with all entries equal to 0 apart from one entry on the diagonal equal to 1, 

2 ) q matrices indexed by 1 < j < g, with all entries equal to zero apart from the four entries 
(0,0),(0,j),(j,0),(j,j) equal to 1. 

For the tensor Tew we consider the same matrices, however both groups have one more 
element. □ 

Coppersmith and Winograd used Tew to show to < 2 . 3755 . In subsequent work Stothers [ 39 ] . 
resp. V. Williams [ 46 ], resp. LeGall [ 32 ] used T®^ resp. resp. and T®^ leading to 

the current “world record” uj < 2 . 3728639 . 

Ambainis, Filmus and LeGall [2] showed that taking higher powers of Tew when g > 5 cannot 
prove oj < 2.30 by this method alone. Their suggestion that one should look for new tensors to 
prove further upper bounds was one motivation for this paper. 


fq,ew{C*) = 


/ xo 

xi xo 0 
0 xo 


X2 


0 


0 


\Xq+l Xl ■■■ 

Proposition 7.1. R{Tqfiw) = 2 g + 1 , R{fq^ew) = 2 g + 3 . 


7 . 3 . Strassen’s tensor. Strassen uses the following concise tensor to show u < 2 . 48 : 


<? 

(10) Tstr,q = E ao^bj^Cj + aj^bo^j e 


which has border rank g + 1, as the the g vectors [ao^bj^Cj + aj06o®Cj], 1 < j < g, are tangent 
vectors to g points [ao® 5 o®ci],•••, [ao®fco®Cg] that lie on the = P{ao®6o0(ci,•••,Cg)} c 
Seg{¥A x WB x PC'). Any linear combination of g + 1 tangent vectors based at g + 1 linearly 
dependent points, with any size g subset independent, of any variety, has border rank at most 
g + 1, see lai § 10 . 1 ]. Here we just take one of the vectors to be zero. Note that Tstr,q is a 
specialization of Tew,q obtained by setting cq = 0 . By the substitution method the rank of the 
tensor equals 2g. 

The corresponding linear spaces are: 


Tstr.qiC*) 


< 0 Xl 
Xl 0 

X2 


Xg'^ 

0 


\Xg 


0 / 


0 
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and 


(xi 


Tstr,M*) 


Xo 

0 


X2 

0 

Xo 


Xq^ 

0 


\0 0 Xo/ 

Actually Strassen uses the tensor product of this tensor with its images under Z3 acting on 
the three factors: f := T®T'®T" where T',T" are cyclic permutations of T = Tstr,q- Thus 
f € and R(r) < (g + l)^. 


7 . 4 . Extremal tensors. Let A,B,C = C^. There are normal forms for germs of curves in 
Seg{FA x FB x PC') up to order m - 1 , namely 

Tt = {ai + ta2 + ---+t'^~^am + 0{t^))iS>{bi + tb2 + ---+t"^~^bm + 0{t"^))iS>{ci+tc2 + --- + t^~^Cm + 0{t"^)) 

and if the aj, bj, Cj are each linearly independent sets of vectors, we will call the curve general 
to order m - 1. 

Proposition 7.2. Let T € A®B®C = Let T^'^~^\a*) := ^^^\t^oTt{A*). If 

T{A*) = T^'^~^\a*), 

with Tt a curve that is general to order m, then T{A*) is the centralizer of a regular nilpotent 
element. 


Proof. Note that = q\ T,i+j+k=q-‘iai®bj®Ck, i.e., 


/ Xq-2 Xq-3 




xi 0 
xi 0 


...\ 


xi 

0 


0 

0 


V 0 0 - / 

in particular, each space contains the previous ones, and the last equals 

^ Xm Xm -1 ■■■ 3 : 1 ^ 

Xm-l Xm-2 Xi 0 


\ Xl 


Xl 

0 




which is isomorphic to the centralizer of a regular nilpotent element. 


□ 


This provides another, explicit proof that the centralizer of a regular nilpotent element belongs 
to the closure of diagonalizable algebras. 

Proposition 7.3. Let T e A®B®C - C™'0C™'0C™' he of border rank m> 2 . Assume PT(A’'') n 
Seg{FB x PC') = [X] is a single point, and FT[x]Seg{FB x PC') d PT(A’''). Then T is not 
lA-generic. 

Proof. No element of PT'[x] 5 eg((Pi 7 x PC') has rank greater than two. □ 

The purpose of stating Proposition 17.31 is to motivate the following theorem: 
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Theorem 7.4. If Pr(^*) n Seg{¥’B x PC) = [X] is a single point, and ¥T^x]Seg{FB x PC) n 
FT{A*) is a p™'"^ jg l^-geaeric, theii T = Tm-2. cw is isomorphic to the Coppersmith- 

Winograd tensor. 


Proof. For the second, we first show that T is 1 -generic. If we choose bases such that X = 6i0ci, 
then, after changing bases, the P”^”^ must be the projectivization of 


( 11 ) 


Xl 



X2 


Xm—1 

0 


Xm-1 0^ 


/ 


Write T{A*) = span{C,M} for some matrix M. As T is l^-generic we can assume that M 
is invertible. In particular, the last row of M must contain a nonzero entry. In the basis order 
Xl,... ,Xm-i,XI, the space of matrices T{B*) has triangular form and contains matrices with 
nonzero diagonal entries. The proof for T{C*) is analogous, hence T is 1 -generic. 

By ProDosition IS.SI we may assume that T(A*) is contained in the space of symmetric matrices. 
Hence, we may assume that E is as above and M is a symmetric matrix. By further changing 
the basis we may assume that M has: 

(1) the first row and column equal to zero, apart from their last entries that are nonzero (we 
may assume they are equal to 1), 

(2) the last row and column equal to zero apart from their first entries. 

Hence the matrix M is determined by a submatrix M' of rows and columns 2 to m - 1 . As 
T{A*) contains a matrix of maximal rank, the matrix M' must have rank m- 2 . We can change 
the basis x^,. ■ ■, Xm-i in such a way that the quadric corresponding to M' equals h— + • 

This will also change the other matrices, which correspond to quadrics xiXi for 1 < i < m - 1 , but 
will not change the space that they span. We obtain the tensor Tm-2,cw-, that indeed satisfies 
the assumptions of the theorem. □ 


7.5. A second geometric characterization of the Coppersmith-Winograd tensors. 

Compression genericity is defined and discussed in m- Here we just discuss the simplest case. 
We say a 1 -generic, tensor T e A®B®C is maximally compressible if there exists hyperplanes 
Ha c a*, Hb c B*, He c C* such that T \ua^Hb^iIc - 0 - 

If T 6 S^A c A0A0A, we will say T is maximally symmetrie compressible if there exists a 
hyperplane Ha <= A* such that T \ha^Ha^Ha- 0 - 

Recall that a tensor T e C™'0C™'0C™' that is I-generic and satisfies Strassen’s equations is 
strictly isomorphic to a tensor in 

Theorem 7.5. Let T e he 1 -generic and maximally symmetric compressible. Then T is 

one of: 

( 1 ) Tm-l,CW 

( 2 ) Tm-2,CW 

( 3 ) T = ai(af h—0^)- a subspace of C”*0C”*, this is 

f Xl X2 ■■■ Xrrd 

X2 Xl 0 
X3 0 Xl 
; 0 

\xm 0 Xl / 
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In particular, the only 1 -generic, maximally symmetric compressible, minimal border rank tensor 
in C™ 0 C™ 0 C™ is fm-2,CW- 

Proof. Let ai be a basis of the line Ha^ c C™. Then T = aiQ for some Q e By 1 - 

genericity, the rank of Q is either m or m - 1 . If the rank is m, there are two cases, either the 
hyperplane Ha is tangent to Q, or it intersects it transversely. The second is case 3 . The first 
has a normal form ai(aiam + 02"'— + which, when written as a tensor, is Tm-2,CW- If Q 

has rank m - 1, by 1-genericity, its vertex must be in Ha and thus we may choose coordinates 
such that Q = {a^ h— + Om)i then T, written as a tensor is Tm-i,cw- D 
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